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CONSTRUCTION OF OPTIMAL MULTI-LEVEL 
SUPERSATURATED DESIGNS 
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A supersaturated design is a design whose run size is not large 
enough for estimating all the main effects. The goodness of multi-level 
supersaturated designs can be judged by the generalized minimum 
aberration criterion proposed by Xu and Wu [Ann. Statist. 29 (2001) 
1066-1077]. A new lower bound is derived and general construction 
methods are proposed for multi-level supersaturated designs. Inspired 
by the Addelman-Kempthorne construction of orthogonal arrays, 
several classes of optimal multi-level supersaturated designs are given 
in explicit form: Columns are labeled with linear or quadratic poly- 
nomials and rows are points over a finite field. Additive characters 
are used to study the properties of resulting designs. Some small op- 
timal supersaturated designs of 3, 4 and 5 levels are listed with their 
properties. 

1. Introduction. As science and technology have advanced to a higher 
level, investigators are becoming more interested in and capable of study- 
ing large-scale systems. Typically these systems have many factors that can 
be varied during design and operation. The cost of probing and studying 
a large-scale system can be prohibitively expensive. Building prototypes is 
time-consuming and costly. Even the quicker route of using computer mod- 
eling can take up many hours of CPU time. To address the challenges posed 
by this technological trend, research in experimental design has lately fo- 
cused on the class of supersaturated designs for its run size economy and 
mathematical novelty. Formally, a supersaturated design (SSD) is a design 
whose run size is not large enough for estimating all the main effects repre- 
sented by the columns of the design matrix. The design and analysis rely on 
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the assumption of the effect sparsity principle ([5], [31], Section 3.5), that is, 
the number of relatively important effects in a factorial experiment is small. 
Some practical applications of SSDs can be found in [18, 19, 25, 30]. 

The construction of SSD dates back to Satterthwaite [26] and Booth and 
Cox [4]. The former suggested the use of random balanced designs and the 
latter proposed an algorithm to construct systematic SSDs. Many methods 
have been proposed for constructing two-level SSDs in the last decade, for 
example, among others, Lin [18, 19], Wu [30], Nguyen [25], Cheng [10], Li 
and Wu [16], Tang and Wu [29], Butler, Mead, Eskridge and Gilmour [7], 
Bulutoglu and Cheng [6] and Liu and Dean [20]. A popular criterion in the 
SSD literature is the -E(s^) criterion [4], which measures the average cor- 
relation among columns. Nguyen [25] and Tang and Wu [29] independently 
derived the following lower bound for two-level SSDs with N runs and m 
factors: 

(1) Eis"^) > N'^{m -N + l)/[(m - 1){N - 1)]. 

This lower bound was recently improved by Butler, Mead, Eskridge and 
Gilmour [7] and Bulutoglu and Cheng [6]. 

There are a few recent papers on the construction of multi-level SSDs. 
Yamada and Lin [37] and Yamada, Ikebe, Hashiguchi and Niki [36] proposed 
methods for the construction of three-level SSDs. Fang, Lin and Ma [13] 
and Lu and Sun [22] proposed algorithmic methods for the construction of 
multi-level SSDs. Lu, Hu and Zheng [21] constructed multi-level SSDs based 
on resolvable balanced incomplete block designs. Aggarwal and Gupta [2] 
proposed an algebraic construction method based on Galois field theory. 
Chatterjee and Gupta [8] studied multi-level SSDs with certain search design 
properties. Yamada and Matsui [38] considered the construction of mixed- 
level SSDs. 

Extensions of the -E(s^) criterion to the multi- level case are not unique, 
for example, ave(x^) statistic [37], ave(/) [13] and E{(f) [22]. All these 
extensions measure the overall nonorthogonality between all possible pairs 
of columns. Lu and Sun [22] and Yamada and Matsui [38] derived lower 
bounds for E{d'^) and ave(x^), respectively, which generalize the lower bound 
for E{s^) in (1). 

There is another class of optimality criteria that were originally proposed 
for studying nonregular designs. Generalized minimum aberration (GMA) 
criteria, extensions of the minimum aberration criterion [14], have been pro- 
posed to assess regular or nonregular designs. See [12, 23, 28, 33, 34]. Ob- 
viously, these criteria can be used to assess SSDs as well. In this paper we 
adopt the GMA criterion due to Xu and Wu [34] as the optimality criterion 
for two reasons. First, the GMA criterion has good statistical properties and 
has been well justified for nonregular designs. Tang and Deng [28] and Xu 
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and Wu [34] showed that GMA orthogonal designs are model robust in the 
sense that they tend to minimize the contamination of nonnegligible two- 
factor and higher-order interactions on the estimation of the main effects. 
Tang [27] and Ai and Zhang [3] provided projection justifications of the 
GMA criterion. Cheng, Deng and Tang [11] showed that GMA is also sup- 
ported by some traditional model-dependent efficiency criteria. Second, the 
GMA criterion is general and can assess multi-level and mixed-level SSDs. 
It includes E{s'^), ave(x^) and E{(P) as special cases. Section 2 reviews the 
GMA and other optimality criteria. 

Section 3 presents some general optimality results for multi-level SSDs. 
We derive a new lower bound for multi-level SSDs as an extension of (1). 
This new lower bound is tight in many cases; for example, it is tight for 
SSDs with s levels, N = s"^ runs and any number of factors. We also discuss 
the construction of optimal SSDs that achieve this bound. In particular, 
construction methods of Lin [18] and Tang and Wu [29] are extended to 
multi-level SSDs. Furthermore, optimal multi-level SSDs are shown to be 
periodic. 

While an optimal SSD under GMA (and other criteria) may contain fully 
aliased columns, Section 4 describes construction methods that produce 
optimal SSDs without fully aliased columns. Inspired by the Addelman- 
Kempthorne construction of orthogonal arrays, we use linear and quadratic 
polynomials in the construction. Evaluating the polynomials over a finite 
field yields optimal multi-level SSDs. Compared with algorithmic methods, 
our algebraic method has at least two advantages: (i) the constructions are 
explicit and not limited to small run size, and (ii) the properties of resulting 
SSDs can be studied analytically. Section 5 presents some technical proofs 
that use additive characters of a finite field. 

Section 6 lists some small optimal SSDs of 3, 4 and 5 levels and compares 
them with existing ones in terms of three other optimality criteria. For small 
run sizes (< 25), the benefits of our SSDs are marginal; our SSDs may be 
better in terms of one criterion but worse in terms of another criterion than 
existing ones. For 27 runs, our SSDs have more columns and one class of 
our designs is better than existing ones in terms of all three criteria. Section 
7 considers mixed-level SSDs. A lower bound is derived and the method of 
replacement is proposed to construct optimal mixed-level SSDs. 

2. Optimality criteria. Some definitions and notation are necessary in 
order to review the optimality criteria. 

An (N, siS2 ■ ■ ■ Sm)-design is an N xm matrix, where the ith column takes 
values on Si symbols {0, 1, . . . , Sj — 1}. A design is called mixed if not all Si's 
are equal. Two designs are isomorphic if one can be obtained from the other 
through permutations of rows, columns and symbols in each column. An 
OA{N,m,s,t) is an orthogonal array (OA) of runs, m columns, s levels 
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and strength t, in which ah possible level combinations appear equally often 
for any set of t columns. An OA{N,m, s,l) is also called a balanced array. 

We use the notation SSD(^N,siS2' ' ' Sm) to denote an SSD of N runs, 
m columns with levels si, S2, ■ ■ ■ , Sm and use the notation SSD{N, s™) if all 
Si = s. Throughout the paper, as in the literature, we only consider balanced 
SSDs, in which all levels appear equally often for any column. 

2.1. Generalized minimum aberration. For an (A^, si,S2 • ■ • Sm)-design D, 
consider the ANOVA model 

Y = Xoao + Xiai H h XmOm + £, 

where Y is the vector of A^ observations, Oj is the vector of all j'-factor 
interactions, Xj is the matrix of orthonormal contrast coefficients for aj, 
and e is the vector of independent random errors. For j = 0,1, . . . ,m, Xu and 
Wu [34] defined Aj{D), a function of Xj, to measure the aliasing between all 

j-factor interactions and the general mean. Specifically, if Xj = [x-^^], define 

md)=n-^y: 

k 

The GMA criterion sequentially minimizes the generalized wordlength pat- 
terns Ai{D) , A2{D) , A^{D) , Xu and Wu [34] showed that isomorphic 

designs have the same generalized wordlength patterns and therefore are 
not distinguishable under the GMA criterion. 

The generalized wordlength patterns characterize the strength of a design, 
that is, Ai{D) = for i = 1, . . . ,t \i and only if D is an OA of strength t. For 
an SSD, = and A2 > 0. The GMA criterion suggests that we shall first 
minimize A2 and then A3, A4 and so on. Note that A2 measures the overall 
aliasing between all pairs of columns. Indeed, A2 = Yl,i<jf'ij if -R = {fij) is 
the correlation matrix of all the main effects (see [32]). In particular, for a 
two-level design A2 is equal to the sum of squares of correlations between 
all possible pairs of columns. 

The following concept due to Xu [33] is useful in the theoretical develop- 
ment. For a design D = [xik] and a positive integer t, define the tth power 
moment to be 

l<i<j<N 

where 5ij{D) is the number of coincidences between the ith and jth rows, 
that is, the number of k such that Xik = Xjk- 
The following three lemmas are from [33]. 

Lemma 1. Suppose D is an SSD{N,s"^). Then: 



N 

y^.^ik 
1=1 
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(i) Ai{D) = and A2{D) = [{N - Ijs^A'ap) + m^s^ _ Nm{m + s- 

i)]/(2iv); 

(ii) Ki{D) = m{N - s)/[{N - l)s] and K2{D) = [2NA2{D) + Nm{m + 
s-l)-m^s^]/[{N -l)s^]. 

Lemma 2. Suppose D is an SSD{N,s"^). Then A2{D) > [m{s-l){ms- 
m-N + l)]/[2{N-l)]. 

Lemma 3. Suppose D is an SSD{N,s^). If the difference among all 
6ij{D), i <j, does not exceed one, then D has GMA. 

2.2. Other optimality criteria and connections. There are several other 
optimahty criteria for multi-level and mixed-level SSDs. Let ci,...,Cm be 
the columns of an SSD{N, siS2 ■ • ■ Sm) and n^^ be the number of times that 
pair (a, 6) appears as a row in columns Cj and Cj. 

Yamada and Lin [37], Yamada, Ikebe, Hashiguchi and Niki [36] and Ya- 
mada and Matsui [38] defined 

X^(c„ c,-) = i: [nZ - N/{s,s^)f/{N/{s,s,)) 

a=0 6=0 

to evaluate the dependency of columns q and Cj. They proposed the fol- 
lowing two criteria to evaluate the maximum and average dependency of all 
columns: 

ave(x^) = ^ x^{ci,Cj)/[m{m-l)/2] 

and 

max(x^) = max x^{ci,Cj). 

l<i<j<:'m 

Fang, Lin and Ma [13] defined 

fic^,C,)=f:Y.\^at-N/{s.S,)\ 
a=0 b=0 

to measure the nonorthogonality between columns q and cj. They proposed 
to minimize 

ave(/) = V f{ci,Cj)/[m{m-l)/2] and max(/) = ma,x f{ci,Cj) 

, ^ ^ — l<t<i<m 
l<i<]<m - 

and three other criteria. 

When all Si = s, Lu and Sun [22] and Lu, Hu and Zheng [21] defined 

a=0 b=0 
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to measure the "departure from orthogonality" for columns Cj and cj. They 
proposed to minimize 



It is evident that E{cf) = (A^/s^) ave(x^) and max{d?) = (A^/s^) max(x^). 

Lemma 4. For an SSD{N, s'") ; 

(i) ave(x^) = NA2/[m{m - l)/2]; 

(ii) E{£) = N^A2/[s'^m{m-l)/2]. 

The first part of Lemma 4 was proved by Xu [33] and the second part 
follows from the first part. Lemma 4 shows that ave(x^) and E[d?) are 
equivalent to A2; therefore, GMA can be viewed as a refinement of ave(x^) 
and E{(f). 

Note that A2 measures the overall aliasing between columns. It is also 
important to measure the maximum aliasing between columns. For this 
purpose we consider projections and propose the concept of projected A2 
values. For a pair of columns Cj and cj, we define a projected A2 value as 
A2 {ci ,Cj) = A2 (d) , where d consists of the two columns q and cj . Obviously, 
the overall A2 value is equal to the sum of all projected A2 values, that is, 
A2{D) = J2i<i<j<m ^'iici, Cj) . Lemma 4 shows that the maximum projected 
A2 value is equal to max(x^)/A^ or s^max((f^)/iV^; therefore, the maximum 
projected A2 value is equivalent to max(x^) and max((i^). 

3. Some optimality results. In this and the next three sections we study 
multi-level SSDs. 

3.1. A new lower bound. 

Theorem 1. Suppose D is an SSD{N,s^). Then 

A2{D) > [m{s - l){ms - m - N + 1)]/[2{N - 1)] + {N - - ??)/(2iV), 

where rj = m{N - s)/{{N - l)s) - [m{N - s)/{{N - l)s)\ and [xj is the 
largest integer that does not exceed x. The lower bound is achieved if and 
only if the number of coincidences, 5ij{D), differs by at most one for alii < j. 
Furthermore, an SSD achieving the lower bound is optimal under GMA. 

Proof. By Lemma l(ii), K^{D) = [iV(iV - l)/2]-i El<^<,■<iv'5^iP) = 
m{N - s)/{{N - l)s). Then rj = Ki{D) - [Ki{D)\ is the fractional part of 
Ki(D). Since the number of coincidences, 5ij{D), must be an integer, it is 
easy to verify that I^iD) = [N{N - l)/2]~i 'Ei<i<j<N[^ijiD)]^ achieves the 



E{d^)= dl/[m{m -l)/2] and max(d^) 



max dfj . 



l<i<j<m 
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minimum value of Ki{D)'^ + r/(l — ry) when all 5ij{D) take on only one of 
the two values [iiri(D)J and [Xi(Z?)J + 1. Then the lower bound of A2{D) 
follows from Lemma l(i) and some straightforward algebra. By Lemma 3 an 
SSD achieving this lower bound is optimal under GMA. □ 

The lower bound in Theorem 1 is new for multi-level SSDs. Using the 
connection established in Lemma 4, we obtain a new lower bound for ave(x^) 
and E{d?). As will be seen next, there are many cases in which the lower 
bound in Theorem 1 is tight, whereas the lower bound in Lemma 2 is not. 
For example, when = s^, the lower bound in Theorem 1 is tight for any m; 
in contrast, the lower bound in Lemma 2 is tight only when m is a multiple 
of s + 1. 

3.2. Optimal designs. Many optimal SSDs that achieve the lower bound 
in Theorem 1 can be derived from saturated OAs. An 0A(N,t,s,2) is satu- 
rated N — 1 = t{s — 1) . The following lemma from Mukerjee and Wu [24] 
says that the number of coincidences between distinct rows is constant for 
a saturated OA. 

Lemma 5. Suppose H is a saturated OA{N, t,s,2) with t = {N — l)/{s — 
1). Then Sij{H) = {N - s)/[s{s - I)] for any i < j . 

The next lemma shows the change of the A2 values of a design when a 
saturated OA is juxtaposed to it. Readers are referred to Xu and Wu [35] 
for a proof. 

Lemma 6. Suppose H is a saturated OA{N, t,s,2) with t = {N — l)/{s — 
1) and D is an OA{N,m,s,l). Let DUH be the column juxtaposition of D 
andH. Then A2iD U H) = AiiD) + m{s - 1) . 

Tang and Wu [29] first proposed to construct optimal two-level SSDs by 
juxtaposing saturated OAs derived from Hadamard matrices. This method 
can be extended to construct optimal multi-level SSDs. Suppose -Di, . . . 
are k saturated 0A{N,t,s,2)s with t = {N -l)/{s-l).Let D = DiU- ■ -UDk 
be the column juxtaposition, which may have duplicated or fully aliased 
columns. It is evident that Sij{D) = k{N — s)/[s(s — 1)] for any i < j. Then 
by Lemma 3, D is an optimal SSD under GMA. 

As Tang and Wu [29] suggested, to construct an SSD with m = kt — j 
columns, 1 < j < t, we may simply delete the last j columns from D. Though 
the resulting design may not be optimal, it has an A2 value very close to 
the lower bound in Theorem 1. 

If one column is removed from or one (balanced) column is added to D, 
the resulting design is still optimal. Cheng [10] showed that, for two-level 
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SSDs, removing (and resp. adding) two orthogonal columns from (and resp. 
to) D also results in an optimal SSD. This is not true for multi-level SSDs in 
general. For N = , we have a stronger result in Lemma 5 that the number 
of coincidences between any two rows is equal to 1. Then removing (and 
resp. adding) any number of orthogonal columns from (and resp. to) D also 
results in an optimal SSD under GMA, because the resulting design has the 
property that the number of coincidences between any two rows differs by at 
most one. In particular, for any m, the lower bound in Theorem 1 is tight. 

Lin [18] used half fractions of Hadamard matrices to construct two-level 
SSDs by taking a column as the branching column. This method can be 
extended to construct multi-level SSDs as follows. Taking any column of 
a saturated 0A[N,t,s,2) as the branching column, we obtain s fractions 
according to the levels of the branching column. After removing the branch- 
ing column, the fractions have the properties that all columns are balanced 
and the number of coincidences between any two rows is constant. The row 
juxtaposition of any k fractions forms an SSD{kNs~^ ,s^^^) of which the 
number of coincidences between any two rows differs by at most one. By 
Lemma 3 such a design is optimal under GMA. For N = s'^, any subdesign 
is also optimal, because the number of coincidences between any two rows 
is either or 1. 

Because a saturated OA(s", (s" — l)/(s — l),s,2) exists for any prime 
power s, we have the following result. 

Theorem 2. Suppose s is a prime power. 

(i) For any n and k, there exists an optimal SSD(s'^,s'^) that achieves 
the lower bound in Theorem 1, where m = k{s'^ — l)/(s — 1) orm = k{s^ — 1)/ 
(s-l)±l. 

(ii) For any n and k < s, there exists an optimal SSD[ks^ ^,s"^) that 
achieves the lower bound in Theorem 1, where m = (s" — l)/(s — 1) — 1. 

(iii) For any m, there exists an optimal SSD{s'^ , s"^) that achieves the 
lower bound in Theorem 1. 

(iv) For any m< s and k < s, there exists an optimal SSD{ks, s"^) that 
achieves the lower bound in Theorem 1. 

Given N and s, let a2{m) = min{^2(-C) : -D is an SSD(N, s"^)}, where de- 
signs may have fully aliased columns. When N = s^. Theorem 2(iii) implies 
that a2(?7T, + s -|- 1) = a2{m) + m{s — 1) for any m > 1. The following result 
shows that for certain A^, a2{m) is periodic when m is large enough. 

Theorem 3. Suppose a saturated OA{N, t, s, 2) exists with t= {N — 1)/ 
(s — 1). Then there exists a positive integer niQ such that for m > tuq, 02 (m + 
t) = a2{m) + m{s — 1). 
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Readers are referred to Xu and Wu [35] for a proof. This periodicity 
property helps us understand SSDs of large size; it shows how larger op- 
timal SSDs are connected with smaller ones. Chen and Wu [9] previously 
showed a similar periodicity property for maximum resolution and minimum 
aberration designs. 

The above optimal SSDs may contain fully aliased columns, which are not 
useful in practice. The next section presents explicit construction methods 
that produce optimal SSDs without fully aliased columns. 

4. Construction. The construction methods are applicable to any prime 
power. Throughout this section we assume s > 2 is a prime power. Let Fg 
be a Galois field of s elements. For clarity, all proofs are given in the next 
section. 

4.1. Half Addelman-Kempthorne orthogonal arrays. Addelman and 
Kempthorne [1] described a method for constructing 0^(2s",2(s" — 1)/ 
(s — 1) — 1, s, 2) for any prime power s and any n. Such arrays can be natu- 
rally decomposed into two arrays of runs. Each array is an SSD{s'^,s'^) 
with m = 2(s" — — 1) — 1. We now describe how to construct an SSD 
in general. 

In the construction the columns of an array are labeled with linear or 
quadratic polynomials in n variables Xi, . . . ,Xn and the rows are labeled 
with points from F". Let . . . , X„) and /2(Xi, . . . , X„) be two func- 

tions, linear or nonlinear. They correspond to two columns of length when 
evaluated at . The two functions (or columns) are fully aliased if the pair 
has only s level combinations, each combination occurring times; and 
orthogonal if the pair has distinct level combinations, each combination 
occurring times. A pair of fully aliased columns has projected A2 = s — 1 
and a pair of orthogonal columns has projected = 0. 

Following Addelman and Kempthorne [1], fi{Xi, . . . , Xn) and f2{Xi, . . . , Xn) 
are said to be semi- orthogonal to each other if (i) for s odd, the pair has 
(s + l)s/2 distinct level combinations, s combinations occurring s""^ times 
and s{s — l)/2 combinations occurring 2s"~^ times, and (ii) for s even, 
the pair has s^/2 distinct level combinations each occurring 2s"~^ times. 
A pair of semi-orthogonal columns has projected A2 = {s — l)/s for s odd 
and projected A2 = 1 for s even. This result can be easily verified from the 
connection between the ave(x^) statistic and A2 described in Lemma 4. 

Let L{Xi, . . . , Xn) be the set of all nonzero linear functions of Xi, . . . , Xn, 
that is, 

L{Xi, . . . , Xn) = {ciXi -|- • ■ • -|- CnXn ■ Ci G Fg, uot all Ci are zero}. 

Every function in L{Xi, . . . ,Xn) corresponds to a balanced column. Two 
functions /i and /2 in L{Xi, . . . ,Xn) are dependent if there is a nonzero 
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constant c£ Fs such that fi = c/2; otherwise, they are independent. Clearly, 
dependent linear functions correspond to the same column up to level permu- 
tation and, thus, they are fully aliased, while independent linear functions 
correspond to orthogonal columns. A set of (s" — l)/(s — 1) independent 
linear functions generates an OA{s^,{s'^ — l)/(s — l),s,2). The traditional 
convention is to assume the first nonzero element is 1 for each column. For 
convenience, we assume the last nonzero element is 1 for each column. In 
particular, let H{Xi, . . . ,Xn) be the set of all nonzero linear functions of 
Xi , . . . , Xn such that the last nonzero coefficient is 1 . When evaluated at 
F^, H{Xi,...,Xn) is a saturated C>yl(s", (s" - - 1), s, 2). This is in- 
deed the regular fractional factorial design and the construction is called the 
Rao-Hamming construction by Hedayat, Sloane and Stufken ([15], Section 
3.4). 

The key idea of the Addelman-Kempthorne construction is to use quadratic 
functions in addition to linear functions. Let 

(2) QliXi,.. .,Xn) = {Xf + aXi+h:aeFs,he H{X2,.. . 

and gi(Xi, . . . ,X„) = {Xi} U Q\{Xi, . . . 

H{Xi,...,Xn) has (s" - l)/(s - 1) columns and Q\{Xi, . . . ,Xn) has 
(s" — l)/(s — 1) — 1 columns. The column juxtaposition of . . . ,Xn) 

and Ql{Xi,...,Xn) forms an 55D(s",s™) with m = 2(s" - l)/(s - 1) - 1, 
which is a half of an Addelman-Kempthorne OA. 

Example 1. Consider s = 3 and n = 2. The functions are 

X2) = {Xi, X2, Xi + X2, 2X1 + X2}, 

Q\{Xi,X2) = {Xl + X2,Xl + Xi + X2,Xl + 2X1 + X2}, 

X2) = {Xi,Xl + X2,Xl + Xi+ X2,Xf + 2X1 + X2}. 

H{Xi,X2) is an 0^(9,4,3,2) when the functions are evaluated at F^; so is 
Qi {Xl , X2) . They are isomorphic [indeed, there is only one unique 0^(9, 4, 3, 2) 
up to isomorphism] . The column juxtaposition of H{Xi , X2) and Ql {Xi , X2) 
forms an S'S'-D(9, 3^), which is isomorphic to the first (and last) nine rows 
of the commonly used 0^(18,7,3,2) (e.g.. Table 7C.2 of [31]). This SSD 
has an overall A2 = 6 and achieves the lower bound in Theorem 1. Fur- 
thermore, there are no fully aliased columns. Each column of Qi{Xi,X2) is 
semi-orthogonal to three columns of H{Xi,X2) with projected A2 = 2/3. 

In general, we have the following results. 

Lemma 7. When evaluated at F^ , Qi{Xi, . . . ,Xn) is an OA{s^,{s^ - 
l)/(s-l),s,2). 
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Theorem 4. The column juxtaposition of H{Xi, . . . ,Xn) and Ql{Xi, 
...,Xn) forms an 55i)(s", s"*) with m = 2(s" - l)/(s - 1) - 1. It has an 
overall A2 = s"' — s and is optimal under GMA. Furthermore, column Xi 
is orthogonal to all other columns and there are no fully aliased columns if 
s>2. 

(i) For s odd, the possible projected A2 values are and (s — l)/s. There 
are — s)/{s — 1) pairs of semi- orthogonal columns with projected A2 = 
{s-l)/s. 

(ii) For s even, the possible projected A2 values are and 1. There are 
s^ — s pairs of semi- orthogonal columns with projected A2 = l. 

Both Qi{Xi, . . . , Xn) and H{Xi, . . . , Xn) are saturated OAs of the same 
parameters. It is of interest to know whether they are isomorphic. Example 
1 shows that they are isomorphic for n = 2 and s = 3. This is true as long 
as n = 2. When n > 2 and s > 2, they are not isomorphic. The following 
corollary summarizes the result. 

Corollary 1. (i) Forn = 2, Qi{Xi, X2) is isomorphic to the regular 
design H{Xi,X2). 

(ii) Forn > 2 and s > 2, Qi{Xi, . . . ,Xn) is not isomorphic to H{Xi, . . . ,Xn)- 

Corollary l(ii) implies that Qi{Xi, . . . ,Xn) is a nonregular design for 
n > 2 and s > 2. 

4.2. Juxtaposition of saturated orthogonal arrays. As a by-product of 
the half Addelman-Kempthorne construction, we have constructed a satu- 
rated OA, Qi{Xi, . . . , Xn), besides the regular OA, H{Xi, . . . , For any 
h e H{Xi, . . . ,Xn), we can construct a saturated OA, Qh[Xi, . . . ,Xn), as 

follows. Let h = ciXi H h CnXn, not all Cj's being 0. Let k be the largest i 

such that Cj 7^ 0. Then = 1 and Cj = for all i> k. Let Yi = h, Yi = Xj„i 
for 2 < i < k, and Yi = Xi for k < i < n. It is clear that H{Xi, . . . 
is equivalent to H(Yi, . . . ,Yn) up to row and column permutations. De- 
fine . . . , Xn) = Q\{Yi, . . . , Yn) as in (2) by replacing Xi with Yi and 

Qh{Xi,...,Xn)=Ql{Yi,...,Yn). 

Since there are (s" — l)/(s — 1) columns in H(Xi, . . . ,Xn), we obtain 
(s" - - 1) saturated 0^(s", (s" - - l),s,2)s. Although they are 
all isomorphic, we can obtain many optimal multi-level SSDs by juxtaposing 
them. 

Example 2. Consider s = 3 and n = 2. H{Xi,X2) = {Xi,X2,Xi -\- 
X2, 2X1 -I-X2}. For each h G H{Xi, X2), we can define QhiXi, X2) as follows: 

Qx, {Xi,X2) = {Xi,Xf + X2,Xf + Xi + X2,Xl + 2X1 + X2}, 
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{X2,Xl + Xi,Xl + X2 + Xi,Xl + 2X2 + Xi}, 
{Xi + X2,{Xi+X2f + Xu 



Q2Xi+X2{^l,^2) 



{Xi + X2f + 2X1 + X2, {Xi + X2f + 2X2}, 
{2Xi+X2,(2Xi+X2)2 + Xi, 



(2X1 + X2)^ + X2, (2X1 + X2)^ + 2X1 + 2X2}. 



Each Qh{Xi,X2) is a saturated 0^(9,4,3,2) and they are ah isomorphic. 
The column juxtaposition of all four Qh{Xi,X2) has 16 columns: 4 linear 
and 12 quadratic. All linear columns are orthogonal to each other. Each 
linear column is orthogonal to 3 quadratic columns, and semi-orthogonal to 
the other 9 quadratic columns. Each quadratic column is orthogonal to 1 
linear column, semi-orthogonal to the other 3 linear columns, orthogonal to 2 
quadratic columns, and partially aliased (projected A2 = 4/9) with the other 
9 quadratic columns. The 16 columns together form an optimal SSD{9,3^^) 
with an overall A2 = 48. The 12 quadratic columns together form an optimal 
SSD{9,3^'^) with an overall A2 = 24. For the latter design, each column is 
partially aliased with 9 columns with projected A2 = 4/9. 

Theorem 5. Let hi and /12 be two distinct functions in H{Xi, . . . ,Xn). 
The column juxtaposition of Qh^ {Xi , . . . , X„) and Qh^ {Xi , . . . , Xn) forms an 
SSDis"", s"") with m = 2(s" - l)/(s - 1). It has an overall ^2 = - 1 and 
is optimal under GMA. Furthermore, there are no fully aliased columns if s 
is odd or s > 4. 

(i) For s odd, the possible projected A2 values are 0, {s — l)/s, {s — 1)^/ 
and (s — l)/s^. There are 2s pairs with projected A2 = {s — l)/s, s^ pairs 
with projected A2 = {s — l)^/s^ and s'^(s" — s^)/(s — 1) pairs with projected 



(ii) For s even, the possible projected A2 values are 0,1,2 and 3. 

(iii) For s = 4, the possible projected A2 values are 0, 1 and 3. There are 
one pair of fully aliased columns with projected A2 = 3 and 4" — 4 pairs of 
partially aliased columns with projected A2 = 1. 

Theorem 5 states that the column juxtaposition of Qhi (Xi, . . . , Xn) and 
Qfi2iXi, ...,Xn) has the same projected ^42 values and frequencies, inde- 
pendent of the choice of hi and /i2. It is of interest to note that they can 
have different geometric structures and be nonisomorphic to each other. For 
example, when n = 3 and s = 3, the column juxtaposition of Qxi and Qx2 
is not isomorphic to the column juxtaposition of Qxi and Qxs ■ 

Extending Theorem 5, we have the following result. 



A2 = {s-l)/s\ 
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Theorem 6. For 1 < A; < (s" — — 1), let hi, . . . ,hk be k distinct 
functions in H{Xi , . . . , X„) . The column juxtaposition of Qhi {Xi , Xn), 
i = 1, . . . ,k, forms an SSD^s"^, s™") with m = k[s^ — — 1). It has an 
overall A2 = (2)(s" — 1) o-nd is optimal under GMA. Furthermore, there are 
no fully aliased columns if s is odd or s > 4. 

(i) For s odd, the possible projected A2 values are 0, (s — l)/ s, (s — l)^/s^ 
and (s — l)/s^. There are (2)25 pairs with projected A2 = {s — l)/s, (2)5^ 
pairs with projected A2 = {s — l)^/s^ and (2)5^(5" — s^)/(s — 1) pairs with 
projected A2 = {s — l)/s'^ . 

(ii) For s even, the possible projected A2 values are 0, 1,2 and 3. 

(iii) For s = 4, the possible projected A2 values are 0, 1 and 3. There are 
(2) pairs of fully aliased columns with projected A2=3 and (2) (4"" — 4) pairs 
of partially aliased columns with projected A2 = 1- 

When A; = (s"-l)/(s-l), the above SSD has [(s" - l)/(s - 1)]^ columns, 
among which (s" — l)/(s — 1) columns are linear from H{Xi, . . . ,Xn) and 
the rest are quadratic. All quadratic functions form another class of SSDs. 
This SSD does not have semi-orthogonal columns, which have projected 
A2 = {s — l)/s for s odd. 

Theorem 7. Suppose s is odd. For I < k < {s^ — l)/{s — l), let hi, . . . ,hk 
be k distinct functions in H[Xi, . . . ,Xn)- The column juxtaposition of Q*^,{Xi, 
. . . ,Xn), i = I, . . . ,k, forms an SSD{s^,s^) with m = k{s^ — s)/{s — 1). 
There are no fully aliased columns and the possible projected A2 values are 0, 
(s — l)^/s^ and (s — l)/s^. There are (2)8'^ pairs with projected A2 = {s — 
l)^/s^ and (2)'5^(s" — s'^)/{s — 1) pairs with projected A2 = {s - l)/s^. It 
has an overall A2 = (g^s" - 2s + 1). When k = {s"" - l)/{s - 1) - 1 or 
(s"- - l)/(s - 1), the SSD is optimal under GMA. 

Corollary 2. For s odd, the column juxtaposition of Q'^{Xi,X2), /i € 
H{Xi, X2), forms an SSD{s^,s'^'+^>). It has an overall A2 = {s + l)s{s - 
1)^/2 and is optimal under GMA. Each column is orthogonal to s — l columns 
and partially aliased with the other columns with projected A2 = {s — 
lf/s\ 

4.3. Fractions of saturated orthogonal arrays. First consider fractions of 
II{Xi, . . . ,Xn). Without loss of generality, taking Xi as the branching col- 
umn, we obtain s fractions according to the levels of Xi. Each fraction has 
gn-i j-^]2s and (s" — l)/(s — 1) columns: column Xi has only one level and 
all other columns have s levels. The row juxtaposition of any k fractions 
forms an optimal SSD after removing column Xi. 
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Theorem 8. Take any column of H{Xi, . . . ,X„,) as a branching column. 
For k < s, the row juxtaposition of any k fractions forms an SSD{ks^~^ , s™) 
with m = (s" — s)/{s — 1) after removing the branching column. It has an 
overall A2 = (s" — s){s — k)/{2k) and is optimal under GMA. Furthermore, 
all possible projected A2 values are and (s — k)/k. There are (s" — s)/2 
pairs of nonorthogonal columns with projected A2 = {s — k) /k. In particular, 
there are no fully aliased columns for 1 < k < s. 

Next consider fractions of Qi{Xi, . . . ,Xn). If Xi is used as the branching 
column, the row juxtaposition of the fractions has the same property as 
that of H[Xi, . . . ,Xn). In the following theorem, we take Xf + X2 as the 
branching column. 

Theorem 9. Take column Xf + X2 of Qi{Xi, . . . , Xn) as a branching 
column. The row juxtaposition of any k fractions forms an SSD{ks^~^ , s™) 
with m = (s" — s)/{s — 1) after removing the branching column. It has an 
overall A2 = (s" — s){s — k)/{2k) and is optimal under GMA. Furthermore, 
there are no fully aliased columns for 1 < k < s. 

(i) For s odd, there are — + s — l)/2 pairs of nonorthogonal 
columns, s(s — l)/2 pairs with projected A2 = {s — k)/k and — s^)/2 
pairs with projected A2 = {s — k)/{ks). 

(ii) For s even, there are at most (s — l)(s"' — s^ + s)/2 pairs of nonorthog- 
onal columns, s{s — l)/2 pairs with projected ^2 = (s — k^jk and at most 
(s — l)(s" — s^)/2 pairs with projected A2 <1. 

(iii) For s = 4 and k = 2, there are (4" — 4)/2 pairs of nonorthogonal 
columns with projected A2 = 1; for s = 4 and k = 3, there are 6 pairs of 
nonorthogonal columns with projected = 1/3 and 3(4" — 16)/2 pairs with 
projected = 1/9. 

By branching other columns, we can obtain different SSDs as illustrated 
below. 

Example 3. Consider n = 3 and s = 3. The columns of X2, X3) 

are the following: 

Xi , Xf + X2 , Xf + Xi + X2 , Xf + 2X1 + X2 , Xf + X3 , Xf + Xi + X3 , 
Xf + 2X1 + X3,Xf + X2+ X3,Xf + X1 + X2 + Xs,Xf + 2X1 +X2 + X3, 
xf + 2X2 + X3, xf +Xi + 2X2 + X3,Xf + 2X1 + 2X2 + X3. 
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Depending on the branching column, we obtain one of three types of optimal 
SSD{18,3^'^). The frequencies of projected A2 values are the following: 



A2 





1/6 


1/2 


Type 1 


54 





12 


Type 2 


36 


27 


3 


Type 3 


42 


18 


6 



We obtain a type 1 SSD if Xi is used as the branching column, a type 2 
SSD if Xl + aXi + X2 is used as the branching column, and a type 3 SSD 
if Xl + aXi + bX2 + X3 is used as the branching column, where a,b ^ F3. A 
type 2 design is preferred in general because it has the smallest number of 
maximum projected A2- 

5. Some proofs. Additional notation and lemmas are needed for the 
proofs. Let C be the set of complex numbers and F* be the set of nonzero 
elements in Fg. An additive character of Fg is a homomorphism mapping 
X'-Fg such that, for any x,y € Fg, \x{x) \ = 1 and + 2/) = xi^)x{y)- 
Clearly, x(0) = 1 since x(0) = x(0)x(0)- A character is called trivial if xi^) = 
1 for all x; otherwise, it is nontrivial. A nontrivial additive character has the 
property that, for a £ Fg, J2xeFs xi(^^) = s if a = and equals otherwise 
(see, e.g., [17]). 

Let X be a nontrivial additive character. For u £ Fg, the function Xu{x) = 
x{ux) defines a character of Fg. Then xo is a trivial character and all other 
characters Xu are nontrivial. It is important to note that {xu,u G F*} fo rms 
a set of orthonormal contrasts defined in [34], that is, J2x<^Fs Xuix)Xv{x) = s 
a u = v and equals otherwise. As a result, we can use additive characters 
to compute the generalized wordlength pattern. In particular, for a column 
x = {xi, . . . ,xn)'^ , the orthonormal contrast coefficient matrix is {Xu{xi)), 
where u G F* and i = 1, . . . , N . For a pair of columns x = {xi, . . . ,xn)'^ and 
y = (yi, . . . , vn)"^ , the projected A2 value is 

TV 

(3) A2{x,y) = N~' Y ] 

uiG-F*U2e-F* i=l 

Let s = p^' , where p is a prime. Define a mapping Tr:Fg Fp, called the 

2 r — 1 

trace, as follows: Tr(x) = x + x^ -\- x^ -\- ■ ■ ■ + x^ for any x £ Fg. Let 

(4) x{x) = e2^*'^''(^)/P for any x £ Fg. 

This is a nontrivial additive character and is called the canonical additive 
character of Fg. For s = 2, the canonical additive character is the usual 
contrast coding: x(0) = 1 and x(l) = — 1- 

The following three lemmas are useful when evaluating projected A2 val- 
ues. Interested readers are referred to Xu and Wu [35] for proofs of the 
lemmas in this section. 



J2xiuiXi + U2yi 
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Lemma 8. For s odd, let a£ F* , b,c& Fg, and x be a nontrivial additive 
character. Then \ J2x<^Fs xW^"^ + 62; + c)p = s. 

Lemma 9. For s even, let a,b Fg and x be the canonical additive char- 
acter of Fs defined in (4). Then X^xsF x(fl^^ + bx) = s if a = b'^ and equals 
otherwise. 

Lemma 10. Let G be a subset of Fg, \G\ = k and x be a nontrivial 
additive character. Then J2ueF* I Z^^eG x(^2;)p = {s — k)k. 

The following lemma follows from Lemmas 1-4 and 5a of Addelman and 
Kempthorne [1]. 

Lemma 11. Consider columns Xf + aiXi + hi and 02X1 + /i2, where 
hi,h2 e L{X2, . . . ,Xn) and ai,a2 & Fg. 

(i) // hi and /i2 are independent, they are orthogonal. 

(ii) For s odd, if hi and /12 are dependent, they are semi-orthogonal. 

(iii) For s even, if hi and /i2 are dependent and ai/12 = 02/11; they are 
orthogonal. 

(iv) For s even, if hi and /i2 are dependent and 01/127^02^1? they are 
semi-orthogonal. 

Proof of Theorem 4. The columns of Qi{Xi, . . . ,Xn) are Xi and 
Xf + aiXi + hi, and the columns of H{Xi,...,Xn) are Xi and 02^1 + 
/i2, where a, G Fg and hi € H{X2, ■ . ■ ,Xn). Since both H{Xi, . . . and 
Qi{Xi, . . . , Xn) are saturated OAs and they share column Xi, the optimality 
of the column juxtaposition of H{Xi, . . . and Ql{Xi, . . . ,X„) follows 
from Lemmas 3 and 5. By Lemma 6, the overall A2{H U Ql) = A2{Ql) + 
[(s" - s)/(s - - 1) = (s" - s) since Ql is an OA of strength 2. 

(i) When s is odd, by Lemma 11, X'^ + aiXi + hi and 02X1 + /i2 are 
semi-orthogonal if hi = /12. Therefore, each column of Ql{Xi, . . . ,Xn) is 
semi-orthogonal to s columns of H{Xi , . . . , X^) . Since there are (s" — l)/(s — 
1) — 1 columns in Qi{Xi, . . . ,Xn), there are in total — s)/{s — 1) semi- 
orthogonal pairs of columns with projected A2 = {s — l)/s. 

(ii) When s is even, by Lemma 11, Xf + aiXi + hi and 02^1 + /i2 are semi- 
orthogonal if hi = /i2 and ai 7^ 02. Therefore, each column of Qi{Xi, . . . , Xn) 
is semi-orthogonal to s — 1 columns of H{Xi, . . . , X^)- Since there are (s" — 
l)/(s — 1) — 1 columns in Qi{Xi, . . . ,Xn), there are in total — s semi- 
orthogonal pairs of columns with projected A2 = l. □ 

Proof of Corollary 1. (i) Let Yi = Xi and ^2 = -'^i + -^^2 • This is a 
one-to-one mapping from (Yi,l2) to {Xi,X2). The columns of Qi{Xi, X2) 
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are Xi = Yi and Xf + aXi + X2 = aYi + Y2, where o G -F,. Therefore, 
Qi{Xi,X2) = H{Yi,Y2) is isomorphic to H{Xi,X2). 

(ii) It follows from Theorems 8 and 9 to be proven later. □ 

Lemma 12. Suppose hi € ^(^3, • • . ,Xn) and ai,bi G Fg for i = 1,2. 

(i) // hi and /12 are independent, Xf + aiXi + 61X2 + hi and X2 + 
0-2X2 + b2Xi + /i2 are orthogonal. 

(ii) // 62 ^0, Xf + aiXi + 61X2 + hi and X| + 02^2 + 62^1 are orthog- 
onal. 

(iii) // hi and /i2 are dependent, the pair of columns Xf + aiXi + 61X2 + 
/ii and + 02X2 + 62-^1 + h2 has projected A2 = {s — l)/s^ for s odd and 
A2 = or 1 for s even. 

(iv) For s odd, the pair of columns Xf + aiXi + X2 and X2 + 02X2 + -'^i 
/las projected A2 = (s — l)^/s^. 

(v) For s even, the pair of columns Xf + aiXi + X2 and X2 + 02^2 + Xi 
has projected A2 = 0, 1, 2 or 3. 

(vi) For s = 4, the pair of columns Xf + aiXi + X2 anc? X2 + 02^2 + Xi 
has projected A2 = 3 if ai = 02 = 0, A2 = 1 if both ai ^ and a2 7^ 0, and 
A2 = otherwise. 

Proof of Theorem 5. Without loss of generality, we assume hi = Xi 
and /i2 = X2. Since both Qxi{Xi, . . . , Xn) and Qx2i^i, ■ ■ ■ , ^n) are satu- 
rated OAs, the GMA optimality and the overall A2 = s" — 1 follow from 
Lemmas 3, 5 and 6. 

(i) The columns of QxiiXi, . . . , Xn) fall into three types: (a) Xi, (b) 
xf + aiXi + X2 and (c) Xf + aiXi + 61X2 + gi, where ai,6i G Fs and 
gi G H{X3, . . . , Xn). Similarly, the columns of Qx2{Xi, ■ ■ ■ 1 ^n) fall into 
three types: (a) X2, (b) X| + 02^2 + Xi and (c) X| + 02X2 + 62X1 + 52, 
where 02, 62 € and (72 G H[X^, . . . , The projected A2 values of all pos- 
sible pairs can be found in Lemmas ll(ii), ll(i), 12(iv), 12(ii) and 12(i)(iii), 
respectively. In summary, we have the following aliasing patterns: 







X2 


+ 02X2 + Xl 


X^ + 02X2 + 62X1 + g2 


Xi 







(.-1)/. 





Xl + aiXi - 


vx^ 


{s-l)/s 







Xl + aiXi - 




^.91 





Sgi.g2{s~'^)/s^ 



where Sg^^^g^ is equal to 1 if gi and 52 are dependent and otherwise. Each 
type (c) column in (Xi, . . . , X„) is partially aliased with type (c) 
columns in Qx2i^ii ■ ■ ■ )X„). The result follows from the fact that the num- 
bers of columns for each type are (a) 1, (b) s and (c) (s" — s^)/(s — 1), 
respectively. 
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(ii) From Lemmas 11 and 12, the possible projected A2 values are 0, 1, 

2 or 3. 

(iii) From Lemmas 11 and 12, the possible projected A2 values are 0, 1 
or 3. Lemma 12 (vi) shows that there is one fully aliased pair: Xf + X2 and 
X2 + Xi, which has projected A2 = 3. Since the overall ^2 = 4*^ — 1, there 
must be 4^^ — 4 pairs with projected = 1. □ 

Proof of Theorem 6. It follows from Theorem 5. □ 

Proof of Theorem 7. We only need prove the GMA optimality. Since 
all linear functions form a saturated OA, the number of coincidences between 
any pair of rows of the resulting SSD is constant when k = (s" — l)/(s — 1) 
and differs by at most one when k = (s" — l)/(s — 1) — 1. Therefore, the 
GMA optimality follows from Lemma 3. □ 

Lemma 13. Let G C Fg and \G\ = k. Suppose Xi takes on values from G 
only and all other Xi take on values from Fs- Suppose /ii, /12 G L{X2., ■ ■ ■ , X^) 
and oi , 02 £ Fg. 

(i) If hi and /12 are independent, aiXi + hi and 02X1 +/12 are orthogo- 
nal. 

(ii) // hi = /12 and ai^ 02, the pair of columns aiXi + hi and 02X1 + /12 
has projected A2 = {s — k)/k. 

Proof of Theorem 8. Without loss of generality, take Xi as the 
branching column. The columns are aXi + h, where a € Fg and h G 
H(X2, ■ ■ ■ ,Xn)- By Lemma 13, each column is partially aliased with s — 1 
columns with projected A2 = (s — k) /k and orthogonal to all other columns. 
Since there are (s" — s)/(s — 1) columns, there are (s" — s)/2 pairs of 
nonorthogonal columns with projected A2 = {s — k)/k. Therefore, the overall 
A2 = {s^ — s){s — k) /{2k) . Finally, the GMA optimality follows from Lemmas 

3 and 5. □ 

Lemma 14. Let G C Fg and \G\ = k. Take Xf + X2 as the branching 
column of Qi{Xi, ... ,Xn), that is, suppose all Xi, i^2, take on values from 
Fg and X^ + X2 takes on values from G only. Suppose h G H{X^, . . . 
and ai , 02 , 61 , 62 G -Fs • 

(i) The pair of columns Xi and Xi + aiXi + X2 has projected A2 = 
{s-k)/k. 

(ii) // oi 7^ a2, the pair of columns Xf + aiXi + X2 and Xf + 02^1 + X2 
has projected A2 = {s — k)/k. 

(iii) For s odd, if hi 7^ 62, ^/^e pair of columns Xf + aiXi + 61X2 + h and 
Xf + 02X1 + 62-^2 + h has projected A2 = {s — k)/ (ks) . 
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Table 1 

Some optimal three-level supersaturated designs 



Projected A2 values 



N 


m 


1/6 


2/9 


4/9 


1/2 


2/3 


Source 






6 


3 








3 




Theorem 8, n = 


2,fc = 


2 


9 


7 










9 


Theorem 4, 71 = 


2 




9 


12 






54 






Theorem 7, n = 


2,fc = 


4 


9 


16 






54 




36 


Theorem 6, n = 


2,fc = 


4 


18 


12 








12 




Theorem 8, n = 


3,fc = 


2 


18 


12 


27 






3 




Theorem 9, n = 


3,fc = 


2 


27 


25 










36 


Theorem 4, n = 


3 




27 


26 




81 


9 




6 


Theorem 6, n = 


3,fc = 


2 


27 


156 




6318 


702 






Theorem 7, n = 


3,fc = 


13 


27 


169 




6318 


702 




468 


Theorem 6, n = 


3,fc = 


13 


54 


39 








39 




Theorem 8, n = 


4,fc = 


2 


54 


39 


108 






3 




Theorem 9, n = 


4,fc = 


2 



(iv) For s even, if bi 7^ 62 and ai ^a2, the pair of columns Xf + aiXi + 
61X2 + /i and Xl + 02^1 + ^2^2 + h has projected A2 <!■ 

(v) For s = 4, if hi ^1)2 and 02, the pair of columns Xf + aiXi + 
biX2 + h and Xf + 02^1 + &2-'^2 + h has projected A2 = or 1 for k = 2, 
and projected j42 = 1/9 for k = 3. 

Proof of Theorem 9. The GMA optimality follows from Lemmas 
3 and 5. Since both designs in Theorems 8 and 9 have GMA, they must 
have the same overall A2 = (s" — s){s — k)/{2k). 

(i) The columns of Qi{Xi, . . .,Xn) are Xi, Xf + aXi + X2 and Xf + 
aXi + 6X2 + h, where a,b € Fg and h G H[X^^ . . . , By Lemma 14(i), 
the pair of columns Xi and Xl + aXi + X2 has projected A2 = {s — k)/k 
when a 7^ 0, and there are s — 1 such pairs; by Lemma 14 (ii), the pair of 
columns Xf + aiXi + X2 and Xf + 02X1 + X2 has projected A2 = {s — 
k)/k when ai ^02, and there are ('^2^) such pairs since column Xf + X2 is 
removed; and by Lemma 14(iii), the pair of columns Xf + aiXi + biX2 + h 
and Xl + 02X1 + 62-^^2 + h has projected A2 = {s — k)/{ks) when bi / 62, 
and there are s^(2)(s"~^ — l)/(s — 1) = s{s^ — s^)/2 such pairs. It is easy to 
verify that all other pairs of columns are orthogonal. 

(ii) and (iii) The proofs are similar to (i) and are omitted. □ 

6. Some small designs and comparison. Applying the construction meth- 
ods, we can obtain many optimal multi-level SSDs. Tables 1-3 list the fre- 
quencies of nonzero projected A2 values for some optimal 3-, 4- and 5-level 



20 



H. XU AND C. F. J. WU 



SSDs. All SSDs have the property that the number of coincidences between 
any pair of rows differs from each other by at most one; therefore, their over- 
all A2 values achieve the lower bound in Theorem 1 and they are optimal 
under GMA. 

When s = 4 and n = 2, according to Theorem 6, the column juxtaposition 
of all five saturated OAs has 10 pairs of fully aliased columns. After removing 
one column from each pair, we obtain 15 columns with projected = or 
1. It can be verified that the resulting SSD has an overall A2 value of 45 
and achieves the lower bound in Theorem 1; therefore, it is optimal under 
GMA. Similarly, when s = 4 and n = 3, the column juxtaposition of all 21 
saturated OAs has 210 pairs of fully aliased columns. After removing one 
column from each pair, we obtain 231 columns with projected = or 1. 
It can be verified that the resulting SSD has an overall A2 value of 3465 and 
achieves the lower bound in Theorem 1; therefore, it is also optimal under 
GMA. 

We compare our SSDs based on Theorems 6 and 7 with existing designs 
from [2, 13, 22]. Since most designs are optimal under overall A2 [or ave(x^)], 
we compare designs in terms of max(x^), ave(/) and max(/). Tables 4 and 5 
show the comparisons for N = 9, 16, 25 and 27 runs in terms of ave(/) and 
max(/). For SSDs from Theorem 7, the first ni columns are used to evaluate 
these criteria. It is possible to find better designs if other columns are chosen. 

Tables 4 and 5 indicate that our SSDs are competitive in terms of max(/) 
but less competitive in terms of ave(/). For = 9,25 and 27, SSDs based 
on Theorem 7 are better than existing ones in terms of both max(x^) and 
max(/). In terms of ave(/), our SSDs are worse than existing ones for = 
9,25 but better for N = 27. For = 16, our SSDs are less competitive. 

Table 2 

Some optimal four-level supersaturated designs 



Projected A2 values 



N 


m 


1/9 


1/3 


1 


Source 


8 


4 






6 


Theorem 8, n = 2, A; = 2 


12 


4 




6 




Theorem 8, n = 2, fc = 3 


16 


9 






12 


Theorem 4, n = 2 


16 


15 






45 


Theorem 6", ?i = 2,fc = 5 


32 


20 






30 


Theorem 8, n = 3, fc = 2 


48 


20 




30 




Theorem 8, n = 3, fc = 3 


48 


20 


72 


6 




Theorem 9, n = 3, fc = 3 


64 


41 






60 


Theorem 4, n = 3 


64 


231 






3465 


Theorem 6", n = 3, fc = 21 



"The design is obtained by removing fully aliased columns. 
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Table 3 

Some optimal five-level supersaturated designs 



Projected A2 values 



N 


m 


2/15 


1/4 


3/10 


16/25 


2/3 


4/5 


3/2 


Source 






10 


5 














10 


Theorem 8, ?i = 


2,fc = 


2 


15 


5 










10 






Theorem 8, n — 


2,k = 


3 


20 


5 




10 












Theorem 8, n = 


2,k = 


4 


25 


11 












25 




Theorem 4, n = 


2 




25 


30 








375 








Theorem 7, n — 


2,fc = 


6 


25 


36 








375 




150 




Theorem 6, ri — 


2,k = 


6 


50 


30 














60 


Theorem 8, n — 


3,k = 


2 


50 


30 






250 








10 


Theorem 9, n = 


3,fc = 


2 


75 


30 










60 






Theorem 8, n = 


3,fc = 


3 


75 


30 


250 








10 






Theorem 9, n — 


3,fc = 


3 



Table 4 

Comparison of supersaturated designs in terms of ave(/) 



Authors Aggarwal 



N 


s 


m 


Theorem 6 


Theorem 7 


Fang et al. 


Lu and Sun and Gupta 


9 


3 


8 


2.57 


3.00 


2.57 


2.57 


2.43 


9 


3 


12 


3.27 


3.27 


3.27 


3.27 


3.06 


9 


3 


16 


3.60 




3.60 


3.60 




9 


3 


28 








4.00 




16 


4 


10 


6.04 




4.36 


4.84 


4.93 


16 


4 


15 


6.86 




5.60 


6.23 


6.27 


16 


4 


20 






6.25 


6.95 




16 


4 


40 








7.87 




25 


5 


12 


8.33 


9.55 


6.42 


8.06 


7.45 


25 


5 


18 


10.78 


10.98 


8.41 


10.42 


9.52 


25 


5 


24 


11.96 


11.67 


10.20 


11.66 


10.86 


25 


5 


30 


12.64 


12.07 




12.33 


11.33 


25 


5 


36 


13.10 






12.73 




27 


3 


26 


3.66 


3.77 


3.78 




4.26 


27 


3 


39 


4.81 


4.81 


5.27 




5.63 


27 


3 


52 


5.38 


5.97 


5.98 




6.32 


27 


3 


65 


5.71 


6.28 






6.73 


27 


3 


156 


6.49 


6.97 








27 


3 


169 


6.53 











We also compare our SSDs based on Theorems 8 and 9 with designs 
from Lu, Hu and Zheng [21], who constructed some small SSDs based on 
resolvable balanced incomplete block designs. We find that our designs have 
the same max(x^) and max(/) values as theirs. Note that their methods 



22 



H. XU AND C. F. J. WU 



Table 5 

Comparison of supersaturated designs in terms of max(/) 



Authors Aggarwal 



N 


s 


m 


Theorem 6 


Theorem 7 


Fang et al. 


Lu and Sun 


and Gupta 


9 


3 


8 


6 


4 


6 


6 


8 


q 


Q 
O 


1 9 


u 


A 


u 


ft 
u 


Q 
O 


9 


3 


16 


6 




6 


6 




9 


3 


28 








6 




16 


4 


10 


16 




12 


12 


12 


16 


4 


15 


16 




12 


12 


14 


16 


4 


20 






16 


12 




16 


4 


40 








16 




25 


5 


12 


20 


14 


22 


18 


24 


25 


5 


18 


20 


14 


24 


20 


24 


25 


5 


24 


20 


14 


30 


20 


32 


25 


5 


30 


20 


14 




22 


32 


25 


5 


36 


20 






22 




27 


3 


26 


18 


12 


16 




16 


27 


3 


39 


18 


12 


18 




16 


27 


3 


52 


18 


12 


18 




16 


27 


3 


65 


18 


12 






16 


27 


3 


156 


18 


12 








27 


3 


169 


18 











depend on the existence of resolvable balanced incomplete block designs, 
which is not an easy task itself. In contrast, our algebraic construction is 
general and works for any s and n. Indeed, SSDs based on Theorems 8 and 
9 with n > 3 are not available in [21]. 

We have presented several classes of optimal SSDs whose columns are 
represented by linear and quadratic polynomials and analytically studied the 
aliasing structure among columns. SSDs based on Theorem 7 are generally 
preferred to those based on Theorems 4 and 6, because the former have 
smaller maximum pairwise aliasing in terms of both max(x^) and max(/). 
Nevertheless, SSDs based on Theorem 4 are useful in some situations. For 
example, when the experimenter isolates one important factor and wants 
to estimate it efficiently, then that factor should be assigned to column Xi 
which is orthogonal to all other columns. 

For easy reference, the Appendix lists some small SSDs based on Theo- 
rems 6 and 7. All SSDs in Tables 1-3 are explicitly listed online at 
www . stat . ucla.edu / ~ hqxu / . 

7. Mixed-level SSDs. The GMA criterion works for mixed-level SSDs. 
The following lemma shows that ave(x^) is again equivalent to A2 for mixed- 
level SSDs. The proof is similar to Lemma 4(i) and is thus omitted. 
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Lemma 15. For an SSD{N,siS2- ■ ■ Sm), sve{x^) = NA2/[m{m - l)/2\. 
The following lower bound of A2 for mixed-level SSDs generalizes Lemma 2. 

Theorem 10. For an SSD{N,siS2- ■ ■ Sm), A2 > {T,T=iSk-m){J2ll^Sk- 
m- N + 1)/[2{N -1)]. 

Proof. Let D = \ 

^ik] be the N x m design matrix. Let ^ (Z?) — 
X^fcLi Sfc5(xjfc, Xjk) be the weighted number of coincidences between the 
rows i and j, where 5{x,y) = 1 if x = y and otherwise. Define Jt{F)) = 

T.i<i<j<N[^\^\D)Y for t = 1,2. Xu ([32], Lemma 2) showed that J2{D) = 
N'^A2{D) + N[Nm{m- l) + NY,Sk- (Esfc)^]/2- The proof there also im- 
plies that Ji{D) = N{Nm -Y.Sk)/2. Thus, the lower bound of A2iD) fol- 
lows from the Cauchy-Schwarz inequality [N{N - 1)/2]J2{D) > [Ji(-D)]^ 
and some straightforward algebra. □ 

The lower bound in Theorem 10 is equivalent to the lower bound of 
ave(x^) given by Yamada and Matsui ([38], Theorem 1) and the lower bound 
of K2 given by Xu ([33], Theorem 6). 

The situation for mixed-level SSDs is more complicated than that for 
multi-level SSDs. Further development is needed to learn whether mixed- 
level SSDs achieving the lower bound in Theorem 10 are optimal under 
GMA. 

Finally, optimal mixed-level SSDs can be generated from multi-level SSDs 
via the method of replacement. For the method of replacement, see [15] 
and Wu and Hamada ([31], Section 7.7). Xu and Wu [34] showed that the 
generalized wordlength patterns are invariant with respect to the choice of 
orthonormal contrasts. As a result, when one or more s-level columns are 
replaced with a saturated OA of run size s and strength 2, the resulting 
mixed-level SSD has the same overall A2 values as the original multi-level 
SSD, and the maximum projected A2 value of the mixed-level SSD is always 
less than or equal to that of the original multi-level SSD. Furthermore, if 
the original multi- level SSD achieves the lower bound of A2 in Lemma 2, 
then the mixed-level SSD achieves the lower bound of A2 in Theorem 10 
and thus is A2 optimal. 

The following example illustrates these ideas. The SSD(81,9^^^) from 
Theorem 6 (with n = 2, s = 9 and k = 10) has overall A2 = 3600 and max- 
imum projected A2 = 8/9. We obtain an 5S'Z)(81, 9^°°-*3''') by replacing 
i 9-level columns with four 3-level columns that form an 0^(9,4,3,2) for 
1 < i < 100. All these mixed-level SSDs have overall A2 = 3600 and projected 
A2 < 8/9. In addition, all these mixed-level SSDs achieve the lower bound 
of A2 in Theorem 10; thus, they are optimal under both A2 and ave(x^). 
However, we do not know whether they are optimal under GMA. 
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Table 6 

SSD{9,3^^) and SSD{9,3^'^) via Theorems 6 and 7 (n = 2, s = 3, k = 4) 



Run 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


14 


15 


16 


1 


















































2 





1 


1 


1 


1 


1 


2 





1 


1 


2 





1 


1 


2 





3 





2 


2 


2 


2 


1 





2 


2 


1 





2 


2 


1 





2 


4 


1 


1 


2 








1 


1 


1 


1 


2 





1 


2 


2 


1 





5 


1 


2 





1 


1 


2 





1 


2 


2 


1 








1 


1 


1 


6 


1 





1 


2 


2 


2 


1 








1 


1 


1 


1 


2 





1 


7 


2 


1 





2 





2 


2 


2 


2 





2 


1 


1 





1 


2 


8 


2 


2 


1 





1 





1 


2 





2 


2 


2 


2 





2 


1 


9 


2 





2 


1 


2 





2 


1 


1 





1 


2 





2 


2 


2 



Notes, (i) All columns form an SSD{9,3^^) with overall A2 — 48; the possible projected 
A2 values are 0, 4/9 and 2/3 with frequencies 30, 54 and 36. (ii) Removing columns (1, 5, 
9, 13) yields an S'S'-D(9, 3^^) with overall A2 = 24; the possible projected A2 values are 
and 4/9 with frequencies 12 and 54. 



Table 7 









SSD{16,4' 


') 


via 


Theorem Q (n 


= 2, 


s = 


4,fc = 


5; 






Run 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


14 


15 


1 















































2 





1 


1 


1 


1 


1 





3 


2 


1 


3 


2 


1 





1 


3 





2 


2 


2 


2 


2 


1 





2 


2 





2 


2 


1 


2 


4 





3 


3 


3 


3 


3 


1 


3 





3 


3 





3 


1 


3 


5 


1 


1 





3 


2 





1 


1 


1 


1 


2 


3 


2 





3 


6 


1 





1 


2 


3 


1 


1 


2 


3 





1 


1 


3 





2 


7 


1 


3 


2 


1 





2 





1 


3 


3 


2 


1 





1 


1 


8 


1 


2 


3 





1 


3 





2 


1 


2 


1 


3 


1 


1 





9 


2 


3 


1 





2 





2 


2 


2 


2 


2 





3 


3 


1 


10 


2 


2 





1 


3 


1 


2 


1 





3 


1 


2 


2 


3 





11 


2 


1 


3 


2 





2 


3 


2 








2 


2 


1 


2 


3 


12 


2 





2 


3 


1 


3 


3 


1 


2 


1 


1 








2 


2 


13 


3 


2 


1 


3 








3 


3 


3 


3 





3 


1 


3 


2 


14 


3 


3 





2 


1 


1 


3 





1 


2 


3 


1 





3 


3 


15 


3 





3 


1 


2 


2 


2 


3 


1 


1 





1 


3 


2 





16 


3 


1 


2 





3 


3 


2 





3 





3 


3 


2 


2 


1 



Notes, (i) This design is obtained by removing a column from each pair 
of fully aliased columns, (ii) The overall A2 value is 45; the possible 
projected A2 values are and 1 with frequencies 60 and 45. 



Table 8 

SSD{25,5^^) and SSD {25, 5^°) via Theorems 6 and 7 (n = 2, s = 5,k = 6) 



Run 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


14 


15 


16 


17 


18 


19 


20 


21 


22 


23 


24 


25 


26 


27 


28 


29 


30 


31 


32 


33 


34 


35 


36 


1 














































































































2 





1 


1 


1 


1 


1 


1 


1 


2 


3 


4 





1 


1 


2 


3 


4 





1 


1 


2 


3 


4 





1 


1 


2 


3 


4 





1 


1 


2 


3 


4 





3 





2 


2 


2 


2 


2 


2 


4 


1 


3 





2 


2 


4 


1 


3 





2 


2 


4 


1 


3 





2 


2 


4 


1 


3 





2 


2 


4 


1 


3 





2 


4 





3 


3 


3 


3 


3 


3 


4 


2 





3 


1 


3 


4 


2 





3 


1 


3 


4 


2 





3 


1 


3 


4 


2 





3 


1 


3 


4 


2 





3 


1 


5 





4 


4 


4 


4 


4 


4 


1 





4 


3 


2 


4 


1 





4 


3 


2 


4 


1 





4 


3 


2 


4 


1 





4 


3 


2 


4 


1 





4 


3 


2 


6 


1 


1 


2 


3 


4 








1 


1 


1 


1 


1 


1 


2 


3 


4 





1 


2 





2 


4 


1 


3 


3 





3 


1 


4 


2 


4 


2 


1 





4 


3 


7 


1 


2 


3 


4 





1 


1 


2 


3 


4 





1 


2 





2 


4 


1 


3 


3 





3 


1 


4 


2 


4 


2 


1 





4 


3 





1 


1 


1 


1 


1 


8 


1 


3 


4 





1 


2 


2 





2 


4 


1 


3 


3 





3 


1 


4 


2 


4 


2 


1 





4 


3 





1 


1 


1 


1 


1 


1 


2 


3 


4 





1 


9 


1 


4 





1 


2 


3 


3 





3 


1 


4 


2 


4 


2 


1 





4 


3 





1 


1 


1 


1 


1 


1 


2 


3 


4 





1 


2 





2 


4 


1 


3 


10 


1 





1 


2 


3 


4 


4 


2 


1 





4 


3 





1 


1 


1 


1 


1 


1 


2 


3 


4 





1 


2 





2 


4 


1 


3 


3 





3 


1 


4 


2 


11 


2 


4 


1 


3 





2 





2 


2 


2 


2 


2 


2 


1 


3 





2 


4 


4 


3 


2 


1 





4 


1 


3 


4 





1 


2 


3 


1 


4 


2 





3 


12 


2 





2 


4 


1 


3 


1 


3 


4 





1 


2 


3 


1 


4 


2 





3 





2 


2 


2 


2 


2 


2 


1 


3 





2 


4 


4 


3 


2 


1 





4 


13 


2 


1 


3 





2 


4 


2 


1 


3 





2 


4 


4 


3 


2 


1 





4 


1 


3 


4 





1 


2 


3 


1 


4 


2 





3 





2 


2 


2 


2 


2 


14 


2 


2 


4 


1 


3 





3 


1 


4 


2 





3 





2 


2 


2 


2 


2 


2 


1 


3 





2 


4 


4 


3 


2 


1 





4 


1 


3 


4 





1 


2 


15 


2 


3 





2 


4 


1 


4 


3 


2 


1 





4 


1 


3 


4 





1 


2 


3 


1 


4 


2 





3 





2 


2 


2 


2 


2 


2 


1 


3 





2 


4 


16 


3 


4 


2 





3 


1 





3 


3 


3 


3 


3 


3 


2 





3 


1 


4 


1 


4 





1 


2 


3 


4 


4 


3 


2 


1 





2 


2 


4 


1 


3 





17 


3 





3 


1 


4 


2 


1 


4 





1 


2 


3 


4 


4 


3 


2 


1 





2 


2 


4 


1 


3 








3 


3 


3 


3 


3 


3 


2 





3 


1 


4 


18 


3 


1 


4 


2 





3 


2 


2 


4 


1 


3 








3 


3 


3 


3 


3 


3 


2 





3 


1 


4 


1 


4 





1 


2 


3 


4 


4 


3 


2 


1 





19 


3 


2 





3 


1 


4 


3 


2 





3 


1 


4 


1 


4 





1 


2 


3 


4 


4 


3 


2 


1 





2 


2 


4 


1 


3 








3 


3 


3 


3 


3 


20 


3 


3 


1 


4 


2 





4 


4 


3 


2 


1 





2 


2 


4 


1 


3 








3 


3 


3 


3 


3 


3 


2 





3 


1 


4 


1 


4 





1 


2 


3 


21 


4 


1 





4 


3 


2 





4 


4 


4 


4 


4 


4 





4 


3 


2 


1 


3 


3 


1 


4 


2 





2 


3 





2 


4 


1 


1 





1 


2 


3 


4 


22 


4 


2 


1 





4 


3 


1 





1 


2 


3 


4 





4 


4 


4 


4 


4 


4 





4 


3 


2 


1 


3 


3 


1 


4 


2 





2 


3 





2 


4 


1 


23 


4 


3 


2 


1 





4 


2 


3 





2 


4 


1 


1 





1 


2 


3 


4 





4 


4 


4 


4 


4 


4 





4 


3 


2 


1 


3 


3 


1 


4 


2 





24 


4 


4 


3 


2 


1 





3 


3 


1 


4 


2 





2 


3 





2 


4 


1 


1 





1 


2 


3 


4 





4 


4 


4 


4 


4 


4 





4 


3 


2 


1 


25 


4 





4 


3 


2 


1 


4 





4 


3 


2 


1 


3 


3 


1 


4 


2 





2 


3 





2 


4 


1 


1 





1 


2 


3 


4 





4 


4 


4 


4 


4 



Notes, (i) All columns form an SSD{25, 5^^) with overall A2 = 360; the possible projected A2 values are 0, 16/25 and 4/5 with frequencies 
105, 375 and 150. (ii) Removing columns (1, 7, 13, 19, 25, 31) yields an SS'D(25, 5^°) with overaU A2 =240; the possible projected A2 
values are and 16/25 with frequencies 60 and 375. 
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